AD-Altt  §47 
UNCLASSIFIED 


A  STUDY  to  determine  the  best  model  and  the  optimal 
FEASIBLE  METHOD  FOR  R. .  <U>  ARMY  RESEARCH  INST  OF 
ENVIRONMENTAL  MEDICINE  NATICK  HA  H  J  SMITH  HAV  82 


A 193  047 


A  STUDY  TO  DETERMINE  THE  BEST  MODEL 
AND  THE  OPTIMAL  FEASIBLE  METHOD  FOR  REDUCING 
NO-SHOW  BEHAVIOR  AT  A  MILITARY  SOCIAL  WORK  CLINIC 


A  Graduate  Research  Project 
Submitted  to  the  Faculty  of 
Baylor  University 
In  Partial  Fulfillment  of  the 
Requirements  for  the  Degree 


Master  of  Health  Administration 


Major  Michael  J.  Smith 
May  1983 


DT1C 

F'  ECTE 
JUN  061988 


for  pub Be  rate 

Distribution  tlnlixnted 


8  8  6 


WSMMSK 


Hi 


a  »  »  v» I'l^u-Lw.amvwi 


ITY  CLASSIFICATION  OF  THIS  PAGE 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


Form  Approved 
OMB  NO.  0704-0188 


la.  REPORT  SECURITY  CLASSIFICATION 

Unclassified 


2a.  SECURITY  CLASSIFICATION  AUTHORITY 


2b.  DECLASSIFICATION /DOWNGRADING  SCHEDULE 


4.  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


6a.  NAME  OF  PERFORMING  ORGANIZATION 
U.S.  Army-Baylor  University  Grad 


3  DISTRIBUTION /AVAILABILITY  OF  REPORT 

Approved  for  public  release; 
Distribution  Unlimited 


5.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


7a.  NAME  OF  MONITORING  ORGANIZATION 


7b.  ADDRESS  {City.  State,  and  ZIP  Code) 


8b.  OFFICE  SYMBOL  I  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable)  | 


10.  SOURCE  OF  FUNDING  NUMBERS 


PROGRAM 
ELEMENT  NO. 


PROJECT 

TASK 

NO. 

NO. 

WORK  UNIT 
ACCESSION  NO. 


6c  ADDRESS  {City,  State,  and  ZIP  Code) 

Ft  Sam  Houston,  TX  78234-6100 


8a.  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 


8c  ADDRESS  (City,  State,  and  ZIP  Code) 


1 1 .  TITLE  (Include  Security  Classification) 

A  Study  to  Determine  the  Best  Model  and  the  Optimal  Feasible  Method  for  Reducing  No-Show 
Behavior  at  a  Military  Social  Work  Clinic 


12  PERSONAL  AUTHOR(S) 

MAJ  Michael  J.  Smith 


13a.  TYPE  OF  REPORT 

Thesis 


16.  SUPPLEMENTARY  NOTATION 


COSATI  CODES 


18  SUBJECT  TERMS  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 

Health  Care;  Appointment  Absenteeism.  -  - - .  _ 


19.  ABSTRACT  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 


15.  PAGE  COUNT 

113 


FIELD 

GROUP 

SUB-GRO 

>The  study  determined  the  best  model  to  describe  the  high  Social  Work  Service  no-show  rate  for  new 
patients  and  developed  alternatives  to  reduce  this  no-show  rate.  The  study  collected  data  in  three 
phases  toensure  that  no  major  actions  changed  in  procedures  of  patient  no-shows  and  that  alternatives 
implemented  were  for  a  thirty-day  trial  period.  The  study  concluded  that  the  variable  element  was 
a  delay  in  the  appointment  request  to  the  appointment  time.  The  alternatives  of  flexible  appointments 
and  improved  screening  by  the  appointment  clerks  did  decrease  the  no-show  rate,  _ ; 


20.  DISTRIBUTION /AVAILABILITY  OF  ABSTRACT 

CXUNCLASSIFIEO/UNLIMITED  □  SAME  AS  RPT  □  OTIC  USERS 


22a.  NAME  OF  RESPONSIBLE  INDIVIDUAL 

e  M.  Leahy,  MAJ,  MS 


DD  Form  1473,  JUN  86  Previous  editions  are  obsolete. 


21  ABSTRACT  SECURITY  CLASSIFICATION 


22b  TELEPHONE  (Include  Area  Code)  22c.  OFFICE  SYMBOL 

512/221-634.5/2324  H  5HA-IHC 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 


1 

I 

w! 


TABLE  OF  CONTENTS 


LIST  OF  ILLUSTRATIONS .  iii 

LIST  OF  TABLES .  iv 

ACKNOWLEDGEMENTS .  v 

Chapter 

I.  INTRODUCTION .  1 

Development  of  the  Problem .  6 

Statement  of  the  Problem .  8 

Limitations .  8 

Assumptions .  10 

Literature  Review .  11 

Research  Methodology .  16 

Footnotes .  20 

II.  DISCUSSION .  22 

Clinic  Appointment  Procedures .  25 

Identification  of  Relevant  Characteristics .  27 

Data  Collection  Technique .  28 

The  Historical  Clinic  No-Show  Rate .  32 

Descriptive  Analysis  of  the  Data .  37 

Discriminant  Analysis  of  the  Data .  39 

Additional  Models  Derived  from  the  Data .  46 

The  Optimal  Feasible  Alternative  for  Reducing  the .  49 

Clinic  No-Show  Rate 

Implementation  of  the  Optimal  Feasible  Alternative .  52 

Footnotes .  54 

III.  CONCLUSIONS .  55 


Implications  of  the  Study .  56  - 

Future  Applications  Within  the  Military  Health .  57  3D  For 

Care  Delivery  System  ’aai  g 

Footnote .  60  *  □ 

iced  Q 

APPENDICES  atlon - 

A.  MARTIN  ARMY  COMMUNITY  HOSPITAL  CONSOLIDATED  NO-SHOW  REPORT .  61  _____ 

it  ion/  __ _ 

1  I  Availability  Coda* 

'  \  j  Uvail  anifi/or~" 

\  »lat  .  f  Spaolai 


B.  SUMMARY  OF  RESEARCH  FINDINGS  ON  PATIENT  CHARACTERISTICS .  63 

AND  THEIR  ASSOCIATION  WITH  NO-SHOW  BEHAVIOR 

C.  SOCIAL  WORK  SERVICE  CLIENT  INFORMATION  SHEET .  69 

D.  PATIENT  CHARACTERISTICS  SELECTED  FROM  INPUT  PROVIDED  BY  THE...  71 

SOCIAL  WORK  SERVICE  STAFF 

E.  DEFINITIONS  USED  THROUGHOUT  THE  STUDY .  75 

F.  SOCIAL  WORK  SERVICE  INTAKE  INTERVIEW  INFORMATION  SHEET .  77 

G.  CONTROL  LOG  FOR  NEW  PATIENTS .  79 

H.  DATA  RETRIEVAL  INSTRUCTIONS  FOR  THE  SOCIAL  WORK  SERVICE .  81 

NO-SHOW  STUDY 

I.  STATISTICAL  SUMMARY  AND  CHI-SQUARE  ANALYSES  COMPARING .  83 

FREQUENCY  DISTRIBUTIONS  OF  PATIENT  CHARACTERISTICS  AMONG 
STUDY  GROUPS 

J.  COMPUTER  PRINTOUT  FROM  THE  SPSS  DISCRIMINANT  ANALYSIS  OF  THE..  87 

DATA 

K.  INSTRUCTION  SHEET  FOR  THE  IMPLEMENTATION  PHASE  OF  THE  STUDY...  99 


BIBLIOGRAPHY 


101 


LIST  OF  ILLUSTRATIONS 


1.  The  Research  Methodology . 

2.  Physical  Layout  of  the  Social  Work  Service  Clinic . 

3.  The  Existing  Patient  Appointment  and  Treatment  System . 

4.  The  Modified  Patient  Appointment  and  Treatment  System . 

5.  Monthly  No-Show  Rates  for  Newly  Appointed  Patients  from  1982 

Clinic  Workload  Data 

6.  Linear  Regression  Equations  Derived  from  Historical  Data _ 

7.  A  Stepping-Stone  Model  for  Describing  No-Show  Behavior  for.. 

Newly  Appointed  Patients  of  the  Social  Work  Service  Clinic 

8.  A  Scatter  Diagram  Model  for  Describing  No-Show  Behavior  for. 

Newly  Appointed  Patients  at  the  Social  Work  Service  Clinic 


LIST  OF  TABLES 

1.  Social  Work  Service  Staffing  During  the  Study .  24 

2.  Population  Supported  by  Martin  Army  Community  Hospital .  24 

3.  Monthly  and  Quarterly  No-Show  Rates  for  the  Social  Work  Service..  34 

Clinic  Based  on  an  Analysis  of  Data  for  Calendar  Year  1982 

4.  Discriminant  Function  Coefficients  from  the  SPSS  Analysis  of . 42 

Data 

5.  Classification  Results  for  Cases  Used  in  the  Discriminant .  44 

Analysis 

6.  Classification  Results  for  Cases  Not  Used  in  the  Discriminant _ 45 

Analysis 

7.  A  Comparison  of  Six  Alternatives  to  Reduce  the  No-Show  Rate  for..  52 

New  Patients  Appointed  at  the  Social  Work  Service  Clinic 


ACKNOWLEDGEMENTS 


A  project  of  this  scope  cannot  be  undertaken  by  one  individual  acting 
alone,  but  requires  the  dedication  and  combined  talents  of  many  to  culminate 
in  a  successful  venture.  I  owe  a  debt  of  gratitude  to  many  conscientious 
people  for  their  generous  contributions. 

I  wish  to  express  my  sincere  appreciation  to  Colonel  Lawrence  K.  Vann, 
my  preceptor,  for  encouraging  me  to  select  a  meaningful  and  challenging  pro¬ 
ject,  for  providing  an  atmosphere  conducive  to  the  successful  pursuit  of 
scholarly  research,  and  for  guiding  me  through  the  entire  residency  year. 

To  the  staff  of  the  Social  Work  Service  at  Martin  Army  Community  Hospital, 

who  wholeheartedly  supported  this  project,  and  especially  to  Ms.  Brenda 
Broussard,  who  painstakingly  collected  data  and  maintained  records  to  assure 
the  validity  of  this  study,  I  owe  special  appreciation. 

A  sincere  thanks  is  extended  to  Mrs.  Elaine  A.  Tate,  Medical  Librarian 
at  Martin  Army  Community  Hospital,  for  her  persistence  in  leaving  no  stone 
unturned  while  locating  the  literature  vital  to  this  project. 

To  Dr.  John  C.  Morey  and  the  staff  of  the  Army  Research  Institute  Field 
Office,  I  express  thanks  for  the  generous  assistance  in  solidifying  the  re¬ 
search  design  and  making  available  the  required  analytical  programs. 

A  very  grateful  acknowledgement  is  offered  to  Mrs.  Mary  L.  Sweatman  for 

her  devotion  to  the  task  of  typing  the  manuscript,  for  her  innovative  contri¬ 

butions  to  the  design  and  aesthetic  appearance  of  the  tables  and  figures 
throughout  this  work,  for  her  persistence  in  not  allowing  me  lu  compromise 


I 


*7 

jj 


P 

i 


yj 

a 


4 


i''  '*/ / yfV*V 


> 


on  the  quality  of  this  product,  and  for  her  overall  enthusiasm.  Mr.  Basil  L. 
Plumley  played  a  key  role  also,  and  I  wish  to  recognize  his  expertise  in  me¬ 
ticulously  reducing  oversized  diagrams  to  complement  the  final  product. 

The  acquiring  of  an  education  is  a  life-long  process  requiring  a  great 
deal  of  sacrifice  not  only  by  the  student  but  by  the  student's  family  as  well 
To  my  wife,  Camilla,  and  children,  Jeffrey  and  Brenda,  who  never  complained 
while  I  devoted  fewer  hours  to  them  and  far  more  to  studies  during  the  past 
two  years,  I  can  find  no  words  to  accurately  express  my  feelings  of  deep 
appreciation. 

This  project  represents  the  culminating  product  of  a  demanding  graduate 
program  which  has  drawn  heavily  on  previously  acquired  skills,  and  I  owe  a 
great  debt  of  gratitude  to  two  special  individuals  who  instilled  within  me 
those  values  and  provided  the  foundation  from  which  this  product  could  emerge 

This  Graduate  Research  Project 
is  dedicated  to 
my  parents 

James  G.  and  Gladys  R.  Smith 

The  opportunity  for  higher  education  is  not  within  the  means  of  all 
people,  whether  for  lack  of  financial  resources,  sufficient  mastery  of  basic 
scholarly  skills,  or  individual  motivation.  A  great  amount  of  credit  for  any 
academic  achievement  should  be  bestowed  upon  those  who  encouraged  the  student 
throughout  the  entire  educational  process  and  who  created  the  opportunity  for 
future  successes  through  personal  sacrifices  and  unconditional  support  of 
basic  and  higher  education.  For  this  and  much  more,  I  thank  my  parents. 


I.  INTRODUCTION 


The  advantages  of  appointment  systems  in  ambulatory  health 
care  settings  have  long  been  recognized.  With  the  exception 
of  emergency  rooms  and  other  crisis-oriented  clinics,  the  in¬ 
dividualized  appointing  of  patients  offers  a  more  convenient 
and  more  personalized  system  while  allowing  the  health  care 
manager  to  better  organize  and  control  resources  available  to 
optimize  the  efficient  delivery  of  services  for  the  population 
supported.  Compared  to  a  nonappointed  or  walk-in  system,  in¬ 
dividualized  appointments  are  clearly  more  acceptable  both  to 
patients  and  to  health  care  providers. 

Special  problems,  however,  have  accompanied  the  establish¬ 
ment  of  appointment  systems  in  most  health  care  settings,  the 
most  significant  being  the  disruptive  effects  of  patients  who 
fail  to  keep  the  scheduled  appointment.  These  adverse  conse¬ 
quences  are  felt  throughout  the  entire  system  and  pose  serious 
problems  for  administrators,  clinicians,  and  others  concerned 
with  efficiency  in  the  delivery  of  health  care.  The  patient 
who  fails  to  report  for  the  scheduled  appointment  is  personally 
affected  because  he  does  not  receive  the  professional  care  re¬ 
quired.  Whether  the  patient  misses  an  initial,  referral,  or 
follow-up  appointment,  he  exposes  himself  unnecessarily  to 
medical  risk  which  could  have  been  more  easily  and  effectively 


treated  if  the  patient  had  been  examined  at  the  appointed  time. 

The  Joint  Commission  on  Accreditation  of  Hospitals  (JCAH), 
an  independent  organization  which  sets  standards  and  conducts 
on-site  surveys  to  measure  compliance,  has  recognized  the  po¬ 
tentially  adverse  impact  of  missed  appointments  upon  the  patient's 
well-being.  In  its  Accreditation  Manual  for  Hospitals,  the  JCAH 
has  included  within  the  quality  assurance  standard  for  ambulatory 
care  services  that  hospitals  shall  establish  a  system  for  the 
follow-up  of  broken  appointments,  when  indicated,  as  well  as 
an  evaluation  of  the  effectiveness  of  that  system.  Although 
this  requirement  is  very  general  and  provides  for  much  discre¬ 
tion,  it  is  clear  that  the  JCAH  has  adopted  the  position  that 
the  health  care  organization,  and  not  only  the  patient,  bears 
responsibility  for  identifying  and  resolving  missed  appoint¬ 
ments  .  ^ 

In  addition  to  the  individual  missing  an  appointment,  other 
patients  are  affected  because  the  health  care  provider,  often 
overburdened  and  accessible  only  through  a  waiting  list  rang¬ 
ing  from  several  days  to  several  months,  is  made  even  more  in¬ 
accessible  by  the  patient  who  occupies  an  appointment  space, 
but  fails  to  keep  or  cancel  the  appointment  in  a  timely  manner. 

The  impact  of  broken  appointments  on  the  health  care  or¬ 
ganization  is  serious,  especially  in  terms  of  wasted  produc¬ 
tivity,  increased  waiting  times  for  appointments,  and  lost 
revenue-earning  opportunities.  In  times  of  tight  budgets, 
decreasing  staff,  and  shrinking  financial  support  from  federal 
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and  other  agencies,  the  pressure  on  management  to  fill  avail¬ 
able  treatment  times  to  optimize  services  provided  and  maximize 
revenue  generated  will  increase  and  may  even  be  the  key  to  sur¬ 
vival  in  a  competitive  environment.  Finally,  the  ever-expanding 
field  of  medical  research  suffers  from  the  patient  who  fails 
to  show  or  drops  out  of  a  treatment  protocol.  This  occurrence 
results  in  an  incomplete  set  of  data,  undetected  episodic  ill¬ 
nesses,  and,  most  seriously,  erroneous  conclusions  reported  in 
the  literature. 

In  addition  to  the  considerations  previously  discussed, 
failed  appointments  have  a  unique  impact  in  the  military  health 
care  setting.  Congress  has  become  greatly  concerned  about  the 
results  achieved  by  the  spending  of  federal  dollars  on  defense, 
and  in  particular  on  health  care  expenditures  in  Army,  Navy, 
and  Air  Force  treatment  facilities.  In  order  to  better  monitor 
and  evaluate  the  cost  of  such  care,  Congress  has  ordered  that 
a  cost-finding  system  known  as  the  Uniform  Chart  of  Accounts 
be  implemented  which  will  clearly  quantify  and  compare  the 
cost  of  health  care  by  specialty,  by  facility,  and  by  branch 
of  the  service.  Any  factor  which  unnecessari ly  increases  the 
cost  of  delivering  the  health  care  services  in  the  federal 
sector  has  become  a  matter  of  great  concern  to  managers  of 
military  medical  facilities,  and  this  concern  will  continue 
to  intensify  as  the  Uniform  Chart  of  Accounts  gains  momentum. 

The  patient  who  fails  to  show  at  the  appointed  time  is  one 
such  factor  which  can  effectively  and  wastefully  idle  costly 


resources  for  the  duration  of  the  scheduled  appointment.  This 
idle  clinic  time  is  often  observed  and  reported  by  other 
patients,  staff  personnel,  and  influential  members  from  the 
supported  community.  The  resulting  situation  is  one  conducive 
to  conflict,  distrust,  and  degraded  morale. 

In  both  the  civilian  and  federal  sectors,  patient  no-shows 
have  complicated  one  of  the  most  important  responsibilities 
faced  by  managers  of  outpatient  cl i ni cs--determi ni ng  the  op¬ 
timal  number  of  patients  to  schedule  once  staffing  levels, 
hours  of  operation,  and  physical  resources  have  been  estab¬ 
lished.  The  manager's  ability  to  accurately  predict  the  level 
of  no-shows  has  a  profound  effect  on  the  operation  of  the  clinic 
If  the  manager  consistently  underestimates  this  level  and  fails 
to  adjust  clinic  schedules  adequately,  valuable  resources  will 
be  underutilized.  The  insidious  impact  of  this  situation  is 
that,  once  wasted,  the  revenue-earning  potential  of  idle  re¬ 
sources  is  lost  forever  and  cannot  be  recovered  unless  pro¬ 
visions  of  compensating  for  patient  no-shows  have  previously 
been  instituted  into  the  scheduling  process.  If  the  manager 
consistently  overestimates  the  number  of  patient  no-shows, 
crowded  waiting  rooms  with  dissatisfied  patients  and  staff 
will  result  as  the  appointees  are  seen  much  later  than  their 
scheduled  time.  The  quality  of  care  delivered  in  such  a  cha¬ 
otic  situation  can  easily  deteriorate  as  the  staff  attempts  to 
catch  up  in  order  to  treat  all  patients. 

The  traditional  approach  towards  managing  no-show  patients 
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has  been  to  examine  the  clinic's  historical  distribution  of 
no-shows,  overbook  appointments,  and,  on  average,  see  the  op¬ 
timal  number  of  patients.  While  this  approach  does  have  merit 
and  has  been  used  successfully,  it  has  inherent  drawbacks. 

Since  overbooking  is  based  on  statistical  averages,  the  actual 
number  of  patients  reporting  to  the  clinic  often  varies  greatly 
from  the  desired  optimal  level.  Furthermore,  this  method  does 
not  address  the  consideration  that  a  no-show  patient  is  one 
who  probably  should  have  been  seen  at  the  clinic,  and  it  directs 
no  attempt  at  encouraging  these  patients  to  keep  their  appoint¬ 
ments.  In  extreme  cases,  health  care  providers  have  faced 
litigation  for  failing  to  identify  and  follow-up  on  patients 
who  miss  appointments.  Merely  overbooking  appointments,  there¬ 
fore,  does  nothing  to  protect  the  practitioner  from  charges  of 
abandonment  and  resultant  harm  from  the  noncontinuation  of  care 
A  more  recent  approach  toward  no-shows  is  to  identify  the  char¬ 
acteristics  of  patients  most  likely  to  miss  their  appointments. 
Once  a  patient  is  identified  as  a  likely  no-show,  either  over¬ 
booking  can  be  applied  or  extra  efforts  can  be  made  to  increase 
the  probability  of  that  patient  reporting  to  the  clinic  at  the 
appointed  time.  Extra  efforts  directed  toward  the  likely  no- 
show  patient,  such  as  mailed  or  telephonic  reminders,  can  help 
protect  the  provider  from  litigation  while  at  the  same  time  in¬ 
creasing  clinic  efficiency. 

Patient  no-shows  have  plagued  outpatient  clinics  for  years 
and,  left  alone,  would  exacerbate  the  situation  previously 


described  to  the  detriment  of  the  health  care  delivery  system 
and,  in  the  military  setting,  to  the  detriment  of  national  readi 
ness.  Any  study,  therefore,  designed  to  identify  the  no-show 
tendencies  of  a  clinic  or  population  segment  is  of  great  value 
because  intensive  and  cost-effective  measures  can  be  instituted 
to  lessen  the  negative  impact  of  that  phenomenon.  If  success¬ 
ful,  the  general  techniques  utilized  in  such  a  study  can  be 
modelled  and  applied  to  alternate  clinic  sites  and  populations. 

Development  of  the  Problem 

The  severity  of  the  no-show  problem  at  Martin  Army  Community 
Hospital  varies  from  clinic  to  clinic  as  depicted  on  the  sta¬ 
tistical  report  at  Appendix  A.  The  Family  Practice  Clinic, 
for  example,  has  experienced  a  very  low  no-show  rate,  while  the 
Obstetrics,  Gynecology,  and  Outpatient  Clinics  have  experienced 
much  higher  rates.  The  Social  Work  Service  Clinic  emerged  as 
the  site  for  this  research  project  for  several  reasons.  During 
the  survey  process  conducted  by  the  JCAH  in  July  1982,  the 
Social  Work  Service  chief  put  himself  on  record  as  being  con¬ 
cerned  about  the  no-show  rate  in  his  clinic,  a  rate  which  he 
felt  was  especially  and  unacceptably  high  for  patients  with 
first-time  appointments.  He  further  established,  and  the  sur¬ 
veyor  concurred,  that  this  situation  constituted  a  quality 
assurance  issue  which  should  be  investigated  and  remedied. 


Subsequent  discussions  with  the  clinic  chief  confirmed 
his  sincere  desire  to  cooperate  in  a  research  effort  designed 


to  better  define  and  reduce  the  extent  of  the  no-show  problem. 
The  chief  was  enthusiastic  about  participating  in  a  study  de¬ 
signed  to  determine  whether  patient  no-shows  in  the  defined 
setting  are,  in  fact,  related  to  certain  identifiable  and  quan¬ 
tifiable  factors,  whether  those  factors  can  be  related  to  char¬ 
acteristics  of  the  patients,  and  whether  the  no-show  rate  can 
be  significantly  reduced  in  a  cost-effective  manner.  Further¬ 
more,  this  clinic  offered  a  manageable  sub-population  consist¬ 
ing  of  newly  appointed  patients,  providing  the  researcher  a 
well-defined  market  segment  which  could  be  modelled  and  ana¬ 
lyzed,  and  which  would  be  adaptable  to  a  full  range  of  experi¬ 
mental  approaches  aimed  at  reducing  the  adverse  impact  of  failed 
appointments.  Approaches  which  could  be  considered  include 
overbooking,  patient  reminders,  and  creating  a  sense  of  obli¬ 
gation  and  confidence  in  the  appointee  by  extending  the  inter¬ 
viewing  procedure  tel ephoni cal ly  during  the  appointment  process. 
Finally,  the  historical  no-show  rate  had  not  been  followed  and 
scrutinized  well  by  management  personnel,  as  evidenced  by  the 
absence  of  data  for  that  clinic  on  the  report  at  Appendix  A. 

In  addition  to  serving  the  research  purposes  of  this  project, 
the  selection  of  the  Social  Work  Service  Clinic  would  provide 
sufficient  statistical  information  and  motivation  to  better 
monitor  no-show  patterns  in  this  clinical  setting. 

The  clinic  chief  was  asked  to  provide  preliminary  infor¬ 
mation  and  reported  that  over  a  ten-month  period  (January  to 
October  1982)  no-shows  for  new  appointees  ranged  from  18  to 
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77  percent  with  a  mean  of  49  percent.  Also,  he  reported  that 
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project  was  limited  to  a  thirty-day  period  beginning  20  April 
1983.  A  major  constraint,  therefore,  was  that  the  volume  of 
data  available  for  analysis  was  limited  to  those  new  patients 
appointed  at  the  Social  Work  Service  Clinic  during  a  relatively 
short  period  of  time. 

A  second  major  limitation  was  that  only  those  variables 
selected  at  the  beginning  of  the  study  were  considered  as  in¬ 
fluencing  individual  tendencies  of  patients  to  show  or  fail  to 
show  for  scheduled  appointments.  In  fact,  the  variables  them¬ 
selves  were  selected  not  only  because  social  work  personnel 
felt  a  strong  connection  between  those  characteristics  and  no- 
show  tendencies,  but  also  because  those  variables  were  easily 
accessible  and  of  practical  utility  in  discriminating  between 
patients  most  and  least  likely  to  show  for  scheduled  appoint¬ 
ments  . 

Other  factors  limiting  the  project  were  associated  with 
the  automation  support  available,  the  Statistical  Package  for 
the  Social  Sciences  (SPSS),  the  specific  parameters  of  which 
will  be  discussed  later  in  this  paper.  A  significant  limita¬ 
tion  with  the  discriminant  analysis  subprogram  of  SPSS  is 
that,  while  an  optimal  solution  is  generated  using  the  step¬ 
wise  procedure,  the  maximal  solution  is  not  necessarily  de¬ 
rived  due  to  the  program  itself  and  to  the  i mprac t i ca 1 i ty  of 
examining  all  possible  combinations  of  variables  for  extent 
of  discriminating  power. 
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One  key  assumption  in  interpreting  the  results  of  this 
study  is  that  the  data  collected  is  representative  of  actual 
tendencies  in  the  larger  patient  population  and  that  no  extra¬ 
neous  factors  were  introduced  in  the  study  design  to  alter 
those  tendencies.  The  preliminary  statistical  data  concerning 
clinic  utilization  and  prevailing  no-show  patterns  was  assumed 
accurate,  and  the  continuation  of  these  behaviors  within  the 
patient  population  was  presupposed.  The  stable  staffing  of 
the  Social  Work  Service  and  the  continued  capability  of  staff 
members  to  support  this  study  were  also  assumed. 

Certain  assumptions  are  inherent  in  the  mathematical  model, 
two-group  discriminant  analysis,  which  was  employed  to  analyze 
the  data.  In  order  to  meaningfully  interpret  and  apply  the  re¬ 
sults  of  this  technique,  it  is  necessary  to  assume  that  the 
most  relevant  characteristics  which  influence  no-show  behavior 
were  selected  and  that  the  two  groups  specified  in  the  model 
as  being  dependent  on  those  characteri sties  were,  in  fact, 
correct.  The  practical  meaning  of  this  assumption  is  that  even 
if  valid  patient  characteristics  were  selected  as  independent 
variables,  the  dependent  variable,  show  or  no-show,  may  have 
been  incorrectly  stated,  and  the  characteristics  may  actually 
influence  some  other  factor  related  or  unrelated  to  no-show 
tendencies,  such  as  patient  willingness  to  comply  with  treat¬ 
ment  regimen  or  even  staff  preference  for  type  of  patient. 
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Unlike  mathematical  models  such  as  regression  analysis 
which  require  normality  of  the  dependent  variable,  the  sta¬ 
tistical  theory  of  discriminant  analysis  requires  that  the 
multivariate  normality  of  the  independent  variables  be  assumed. 
Finally,  it  was  necessary  to  assume  that  each  patient's  deci¬ 
sion  to  show  or  not  show  for  the  appointment  was  independent  of 
another  patient's  decision  and  that  no  common  occurrence,  such 
as  weather  or  shared  transportation,  was  a  major  determinant. 

Literature  Review 

MEDLINE  and  manual  searches  were  conducted  focusing  on 
techniques  to  model  and  analyze  clinic  no-show  rates.  The 
search  logic  utilized  the  topic  identifiers  of  clinic  no-shows, 
failed  appointments,  broken  appointments,  dropouts,  and  patient 
noncompliance.  Fifty-four  articles  pertaining  to  the  topic  were 
located  and  reviewed.  Most  of  the  studies  in  the  literature 
investigate  appointment-keeping  behavior  at  hospital  outpatient 
clinics  and  psychiatric  or  mental  hygiene  clinics  and  are  con¬ 
centrated  on  pediatric  and  low  socioeconomic  populations.  From 
the  literature  review,  it  became  evident  that  little  data  exists 
for  no-show  rates  in  private  practices,  although  one  study  did 

report  that  private  pediatricians  have  failed  appointments  of 
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less  than  5  percent.  Furthermore,  it  became  clear  that  al¬ 
though  much  attention  has  been  given  to  predicting  early  drop¬ 
outs  among  patients  who  have  already  entered  a  therapeutic 
regimen,  much  less  is  known  of  patients  who  schedule,  but  sub¬ 
sequently  do  not  keep  their  first  appointment.  Also,  most 


published  studies  have  dealt  with  the  problem  only  to  the  point 
of  characterizing  the  likely  no-show  patient,  while  few  have 
attempted  interventions  to  reduce  that  phenomenon. 

Of  forty-two  independent  studies  which  were  reviewed,  eleven 
dealt  with  hospital  outpatient  departments,  medical  care  clinics 
or  primary  care  clinics;  ten  were  concerned  with  psychiatric  or 
mental  hygiene  clinics;  and  eight  with  pediatric  outpatient  de¬ 
partments  or  clinics.  Only  two  articles  were  located  which  dis¬ 
cussed  the  no-show  problem  in  federal  facilities,  one  from  a 
Veteran's  Administration  Medical  Center  and  one  from  an  Army 
dental  clinic  in  Europe.  Overall  no-show  rates  reported  in 
the  literature  ranged  from  15  to  52  percent.  The  predominant 
investigative  technique,  with  very  few  exceptions,  was  a  uni¬ 
variate  chi-square  analysis  of  data  concerning  the  character¬ 
istics  of  patients  scheduled  at  the  clinic.  Researchers  typ¬ 
ically  reported  that  certain  characteristics  were  either  sig¬ 
nificantly  related  to  no-show  behavior  or  not  significantly 
related.  Appendix  B  summarizes  the  research  findings  of  pa¬ 
tient  characteristics  and  their  association  with  no-show  be¬ 
havior  which  were  drawn  from  the  literature  review.  Many  of 
the  inconsistencies  in  the  conclusions  derived  from  these 
studies  can  be  attributed  to  differences  in  types  of  clinic, 
population  served,  and  the  researchers'  definitions  of  key 
terms  . 

Representative  of  the  studies  documented  in  the  literature 
is  that  of  Carpenter,  et  al . ,  who  collected  data  at  a  hospital- 
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based  psychiatric  clinic  pertaining  to  ten  demographic  and 
clinical  variables  and  used  the  typical  technique  of  chi-square 
analyses  of  differences  between  the  show  and  no-show  groups. 

Uf  the  demographic  characteri s tics  sex,  area  of  residence, 
distance  of  travel,  age,  socioeconomic  status,  and  marital 
status,  these  researchers  found  age  as  the  only  variable  which 
significantly  differentiated  the  two  groups.  Specifically,  pa¬ 
tients  eighteen  to  twenty-four  years  old  were  significantly 
less  likely  to  keep  their  appointments  than  any  other  age 
group.  Of  the  clinical  characteristics  investigated,  it  was 
determined  that  patients  with  no  prior  psychiatric  treatment 
were  significantly  less  likely  to  keep  their  initial  appointment, 
that  patients  referred  from  a  medical  clinic  or  local  physician 
were  more  likely  to  keep  their  appointment  than  those  referred 
by  themselves,  friends,  relatives,  or  an  emergency  room,  and 
that  a  greater  proportion  of  patients  offering  vague  or  evasive 
reasons  for  the  appointment  failed  the  initial  appointment. 
Finally,  this  study  concluded  that  patients  who  did  not  keep 
the  initial  appointment  had  to  wait  a  significantly  longer 
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period  of  time  for  that  appointment  than  those  who  showed. 

An  examination  of  Appendix  B  reveals  certain  conclusions 
from  the  literature  published  to  date.  Although  the  patient's 
sex  has  generally  not  been  found  to  be  a  good  predictor  of 
missed  appointments,  it  appears  that  younger  patients  have  a 
greater  tendency  to  miss  than  older  patients.  The  impact  of 
race  has  been  widely  reported  and  discussed  with  mixed  results 


reported  in  the  literature.  Barron  has  concluded  that  race  per 

se  is  probably  not  a  factor,  but  that  no-show  rates  of  minority 

populations  are  related  more  to  socioeconomic  factors  prevalent 
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within  those  racial  groups.  When  studied,  it  appears  that  the 
patient's  previous  attendance  record  is  a  good  predictor  of 
future  behavior.  Hofmann  and  Rockert  demonstrated  the  validity 
of  this  conclusion  by  showing  that  when  patients  are  automati¬ 
cally  reappointed  after  failing  an  appointment,  the  overall 
clinic  no-show  rate  increased  significantly.^  Referral  source 
has  an  effect,  with  patients  referred  by  themselves  and  emer¬ 
gency  rooms  showing  lower  appoi ntment- keepi ng  behavior  than 
those  referred  by  a  specific  physician.  A  psychiatric  type  of 
medical  problem  may  be  more  related  to  no-show  behavior  than 
other  diagnoses.  Finally,  the  time  delay  awaiting  the  appoint¬ 
ment  is  apparently  significantly  related  to  no-show  behavior 
with  longer  delays  resulting  in  more  failed  appointments. 

Although  the  chi-square  method  of  analyzing  and  modelling 
clinic  no-show  behavior  was  the  most  commonly  used  in  the 
literature,  two  other  methods  were  reported.  Shonick  and  Klein 
developed  a  model  based  on  estimated  conditional  probabilities 
utilizing  the  patient  characteristics  of  age,  sex,  and  the  num¬ 
ber  cf  previous  appointments,  the  validity  of  which  had  been 
ascertained  through  preliminary  chi-square  analyses.7  Dervin, 
Stone,  and  Beck  utilized  the  SPSS  discriminant  analysis  sub¬ 
program  in  analyzing  ten  characteristics  thought  to  be  pre¬ 
dictors  of  appointment-keeping  behavior  at  a  family  practice 
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center.  These  researchers  found  that,  although  the  combined 
effect  of  all  variables  did  reach  statistical  significance,  the 
two-group  discriminant  analysis  technique  had  failed  to  prove 
its  practical  utility  and  would  likely  not  be  an  effective 
model  for  clinics  with  no-show  rates  of  less  than  40  percent. 
They  did  suggest,  however,  that  future  investigators  concentrate 
on  variables  which  were  among  the  better  predictors  in  their 
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study,  especially  telephone  ownership  and  marital  status. 

Most  of  the  interventions  reported  in  the  literature  to 

reduce  the  rate  of  failed  appointments  were  designed  around 

mailed  or  telephonic  remi nders  and  showed  significant  decreases 
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of  30  to  75  percent  in  the  fail  rate.  Nazarian,  et  al . ,  found 
that  mailing  a  card  reminder  to  patients  scheduled  twelve  days 
to  eight  weeks  in  advance  at  a  mul ti speci al ty  health  clinic  in 
a  low-income  area  reduced  the  no-show  rate  to  36  percent,  com¬ 
pared  to  52  percent  without  reminders.10  At  a  family  practice 
clinic  in  a  middle-class  area,  Hagerman  found  that  although  the 
relative  risk  of  not  showing  for  an  appointment  is  1.65  times 
greater  without  a  mailed  reminder  than  with  one,  the  cancella¬ 
tion  rate  from  those  receiving  reminders  is  more  than  doubled.11 
In  their  elaborate  analysis  comparing  the  cost  and  effectiveness 
of  mailed  versus  telephonic  reminders  in  outpatient  clinics  at 
a  children's  hospital  center,  Shepard  and  Moseley  showed  both 
strategies  to  be  significantly  and  equally  effective  compared 
to  a  control  group.  Using  actual  wage  scales,  postage  rates, 
telephone  costs,  and  the  results  of  ti me-and-moti on  studies, 


they  concluded  that  mailed  reminders  cost  only  twenty  cents  per 
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appointment,  compared  to  forty  cents  for  telephonic  reminders. 
The  follow-up  study  of  Morse,  et  a!.,  after  eight  years'  routine 
use  of  mailed  reminders  at  the  site  of  Nazarian's  earlier  re¬ 
search,  showed  that  although  mailed  reminders  are  effective 

initially,  prolonged  use  has  a  waning  effectiveness  which  di- 
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minishes  with  time.  The  literature  contained  few  examples 
of  intervention  mechanisms  other  than  mailed  or  telephonic  re¬ 
minders.  At  an  adolescent  psychiatric  clinic,  Hildebrandt  and 
Davis  found  that  the  no-show  rate  was  reduced  from  40  percent 

to  10  percent  when  appointed  patients  were  provided  a  home  visit 
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in  advance  of  the  scheduled  appointment. 

In  their  comprehensive  review  of  the  research  on  failed  ap¬ 
pointments,  Deyo  and  Inui  identified  eighty-four  factors  which 
have  been  mentioned  in  the  literature  as  possible  relevant  de¬ 
terminants  of  appoi ntment- keepi ng  behavior.  Also,  in  proposing 
an  agenda  for  future  research,  these  authors  emphasized  that 
future  investigators  should  consider  utilizing  a  wider  range 

of  potentially  predictive  variables  and  should  utilize  more 
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sophisticated  multivariate  analytical  techniques. 

Research  Methodology 

The  research  approach  was  designed  to  complement  clinic 
functioning  and  to  require  as  few  changes  as  possible  to  ex 
isting  operational  procedures.  In  order  to  avoid  altering 
patient  behavior  as  a  result  of  the  research  design  itself, 


a  prime  concern  was  that  no  procedure,  especially  the  actions 
of  the  appointment  clerk,  would  be  changed  from  the  established 
routine  until  that  point  where  the  patient  either  showed  or 
failed  to  show  for  the  initial  appointment.  Prior  to  initiating 
the  project,  the  sequence  of  events  illustrated  at  Figure  1  was 
planned  by  the  researcher  and  the  Social  Work  Service  Clinic 
chief.  The  project  was  planned  in  three  phases:  a  preliminary 
phase,  a  data  collection  and  analysis  phase,  and  an  application 
phase . 

Before  data  could  be  collected,  several  preliminary  tasks 
needed  to  be  accomplished.  A  flow  chart  describing  the  opera¬ 
tional  aspects  of  the  clinic  appointment  procedure  was  prepared 
as  a  tool  for  designing  a  data  collection  mechanism  which  would 
complement  the  existing  system.  Also,  this  model  could  prove 
useful  during  the  application  stage  by  indicating  how  and  where 
to  best  intervene  during  the  appointing  process.  The  entire 
Social  Work  Service  Clinic  staff  was  briefed  on  the  project  in 
order  to  gain  their  support,  clarify  definitions,  and  identify 
those  characteristics  which  should  be  measured  throughout  the 
study.  Based  on  the  staff  input,  it  became  necessary  to  design 
a  form  which  would  replace  an  existing  intake  interview  infor¬ 
mation  sheet  and  which  would  effectively  capture  the  data  re¬ 
quired  for  the  analysis  phase  of  the  project.  The  final  pre¬ 
liminary  step  involved  training  the  appointment  clerk  and  co¬ 
ordinating  with  the  Army  Research  Institute  to  gain  familiarity 
with  the  SPSS  program,  a  process  which  continued  throughout  the 
project . 
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Figure  1.  The  Research  Methodology 


The  data  collection  and  analysis  phase  began  with  the 
simultaneous  collection  of  data,  monitoring  of  the  data  col¬ 
lection  procedure,  and  analysis  of  the  historical  no-show  rate. 
Periodically,  the  researcher  coded  the  data  to  facilitate  later 
analysis  by  the  SPSS  program.  When  sufficient  data  was  col¬ 
lected,  it  was  first  analyzed  utilizing  the  SPSS  subprogram 
FREQUENCIES.  Following  a  chi-square  analysis  of  this  output, 
those  characteristics  which  differed  most  significantly  between 
patients  who  showed  and  those  who  failed  to  show  for  their  ap¬ 
pointments  were  selected  and  the  subprogram  DISCRIMINANT  was 
run.  The  final  step  of  this  phase  was  a  comparison  of  the 
DISCRIMINANT  model  with  other  models  derived  throughout  the 
study  and  the  selection  of  the  best  model. 

The  application  phase  consisted  of  identifying  feasible 
alternatives  for  1 o we  ring  the  no-show  rate  considering  fully 
the  implications  of  the  best  no-show  model  emerging  from  the 
study.  Alternatives  were  measured  against  those  criteria  con¬ 
sidered  most  important  and  the  optimal  feasible  solution  was 
selected.  Finally,  the  selected  alternative  was  implemented 
for  a  thirty-day  trial  period,  the  results  recorded,  and  recom¬ 


mendations  derived. 
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II.  DISCUSSION 


The  Social  Work  Service  Clinic  is  located  in  a  building 
complex  which,  until  the  opening  of  a  more  modern  facility 
in  1958,  was  Martin  Army  Hospital.  Today,  this  former  hos¬ 
pital  is  best  known  as  the  Home  of  the  National  Infantry  Mu¬ 

seum,  but  it  also  accommodates  many  health-oriented  services 
including  the  Physical  Examination  Section,  the  Community  Mental 
Health  Activity,  a  Well  Woman's  Clinic,  and  a  Learning  Abilities 
Center.  The  Social  Work  Clinic  occupies  the  second  floor  of 

one  building  and  is  arranged  to  accommodate  patient  flow  as 

shown  in  Figure  2. 

Table  1  depicts  Social  Work  Service  staffing  during  the 
period  of  the  study.  The  social  work  officer,  captain,  was 
physically  located  in  the  main  hospital  supporting  the  Depart¬ 
ment  of  Family  Practice  and  did  not  counsel  any  new  patients 
which  were  the  subjects  of  this  study.  Similarly,  the  two 
social  service  assistants,  GS-8,  were  assigned  inpatient  func¬ 
tions  at  the  main  hospital  and  did  not  counsel  patients  in¬ 
cluded  in  the  study.  The  secretary-stenographer,  GS-5,  was 
of  particular  importance  because  this  individual  interfaced  with 
the  patient  population  and  functioned  as  the  appointment  clerk 
and  clinic  receptionist.  In  these  capacities,  the  secretary- 
stenographer  was  responsible  for  accomplishing  the  data 


collection  portion  of  the  project, 


TABLE  1 

SOCIAL  WORK  SERVICE  STAFFING  DURING  THE  STUDY 


Although  the  population  supported  by  Martin  Army  Community 
Hospital  is  well  defined  (Table  2)  these  numbers  may  not  ac¬ 
curately  reflect  the  subpopulation  treated  at  the  Social  Work 
Service  Clinic  because  military  personnel  without  dependents 
are  appointed  at  a  separate  clinic  operated  by  the  Community 
Mental  Health  Activity. 

TABLE  2 

POPULATION  SUPPORTED  BY  MARTIN  ARMY  COMMUNITY  HOSPITAL 
(as  of  February  1983) 


Active  Duty  Military 
Dependents  of  Active  Duty 
Retired  Military 

Dependents  of  Retired  and  Deceased 
Civilians 

Other  Beneficiaries 
TOTAL 


24,057 

25,577 

9,212 

19,539 

8,122 

5,828 
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Position  Title 

Grade 

Assigned 

Chief,  Social  Work  Service 

Major 

1 

Social  Work  Officer 

Captain 

1 

Behaviral  Science 

Sergeant 

1 

Specialist  (NCOIC) 

First  Class 

Social  Service  Assistant 

GS-9 

2 

Social  Service  Assistant 

GS-8 

2 

Clerk  Typist 

GS-3 

1 

Secretary-Stenographer 

GS-5 

1 

I 

* 
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Clime  Appointment  Procedures 
The  preliminary  phase  began  with  an  examination  of  the 
operational  aspects  of  the  clinic  with  special  emphasis  on 
appointment-making  procedures.  The  purpose  of  this  examination 
was  to  provide  a  basis  for  designing  a  data  collection  mechan¬ 
ism  which  would  complement  the  existing  system  and  which  would 
not,  of  itself,  alter  patient  appointment-keeping  behavior. 

The  flow  chart  at  Figure  3  illustrates  the  patient  appointment 
and  treatment  system  which  had  been  utilized  at  the  clinic 
prior  to  the  study.  Upon  receiving  a  telephonic  appointment 
request,  the  appointment  clerk  would  first  ascertain  whether 
the  patient  was  currently  being  followed  by  a  member  of  the 
Social  Work  Service  staff.  Patients  being  followed  were  sched¬ 
uled  with  their  counselor  at  the  next  available  and  agreeable 
time,  and  the  patient's  name  was  entered  in  an  appointment  book 
maintained  by  the  clerk.  If  the  caller  indicated  that  he  or 
she  was  not  currently  being  followed,  the  clerk  inquired  about 
the  caller's  name  and  telephone  number,  the  appointee's  name, 
and  the  general  nature  of  the  problem.  Next,  the  appointment 
clerk  would  determine  whether  the  situation  was  of  such  urgency 
to  warrant  immediate  consultation  by  asking  the  caller  if  he  or 
she  would  like  to  speak  with  a  counselor.  If  so,  the  clerk 
would  transfer  the  call  to  an  available  counselor  and  would 
follow  the  counselor's  instructions  regarding  scheduling.  If 
not,  the  clerk  would  schedule  the  patient  at  the  next  available 
and  agreeable  time.  When  patients  reported  for  appointments, 
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the  clerk  greeted  them,  seated  them  in  the  waiting  area,  pro¬ 
vided  them  the  Social  Work  Service  Client  Information  Sheet, 
FB(MED)  Form  30  dated  1  October  1976  (Appendix  C),  and  in¬ 
structed  them  to  complete  the  form.  No  action  was  taken  con¬ 
cerning  patients  who  failed  to  report  for  the  scheduled  appoint 
ment . 

Identification  of  Relevant  Characteristics 

The  entire  Social  Work  Service  Clinic  staff  was  briefed 
to  assure  an  understanding  of  project  objectives,  methodolo¬ 
gies,  and  potential  benefits.  The  staff  enthusiastically  en¬ 
dorsed  the  study  and  participated  as  key  informants  in  a  dis¬ 
cussion  to  determine  which  characteristics  they  felt  were  most 
strongly  associated  with  patients  who  fail  to  show  for  appoint¬ 
ments.  The  staff  agreed  that  first-time  appointees  constituted 
the  majority  of  failed  appointments.  Following  the  briefing, 
the  Social  Work  Service  chief  and  the  researcher  consolidated 
the  recommendations  of  the  group  and  determined  the  seventeen 
variables  which  would  be  measured  during  the  data  collection 
and  analysis  phase  of  the  project. 

Many  of  the  factors  thought  to  be  significantly  related 
to  no-show  behavior  were  similar  or  identical  to  those  pre¬ 
viously  investigated  in  the  literature  while  others  were  unique 
to  the  military  setting  and  had  not  been  studied  previously. 

In  addition  to  the  dependent  variable  of  show/no-show  behavior, 
nine  variables  were  selected  which  are  related  to  the  patient's 
demographic  characteristics  and  seven  which  are  related  to  the 


patient's  clinical  characteristics.  Appendix  D  lists  the 
variable  to  be  measured,  the  measurement  criteria  for  that 
variable,  and  the  collective  a  priori  notion  of  the  Social  Work 
Service  Clinic  staff  regarding  the  effect  of  that  variable  on 
no-show  behavior.  Certain  characteristics  such  as  racial  status 
were  considered  but  rejected  as  variables  because,  although 
possibly  related  to  no-show  behavior,  they  could  serve  no  prac¬ 
tical  application  in  lowering  the  no-show  rate.  Also  discussed 
at  the  staff  briefing  and  agreed  upon  were  a  number  of  key  def¬ 
initions  which  would  be  observed  throughout  the  study.  A  summary 
of  those  definitions  is  at  Appendix  E. 


Data  Collection  Technique 


The  data  collection  technique  was  designed  to  interface 
with  the  existing  appointment  procedure  in  such  a  way  that, 
from  the  patient's  viewpoint,  nothing  had  changed  until  the  pa¬ 
tient  proved  to  be  either  a  show  or  a  no-show.  This  condition 
was  critical  because,  if  the  data  collection  technique  itself 


could  potentially  affect  attendance  behavior,  a  control  group 
would  be  required  to  test  for  that  influence.  For  this  study, 
a  control  group  was  not  feasible  because  the  anticipated  volume 
of  newly  appointed  patients  and  time  constraints  would  not  sup¬ 
port  the  establishment  of  an  additional  group. 

In  order  to  collect  and  record  data  pertaining  to  the 


seventeen  variables  which  had  been  identified,  it  was  necessary 
to  design  and  incorporate  a  preprinted  form  inlc  *he  research 
design.  The  Social  Work  Service  Client  Information  Sheet 


(Appendix  C),  which  the  clinic  staff  had  been  using  to  obtain 
information  about  the  patient  prior  to  the  actual  appointment, 
provided  an  excellent  opportunity  to  implement  a  similar  form 
which  would  also  support  the  study.  The  staff  had  expressed 
dissatisfaction  with  the  design  and  content  of  the  existing  in¬ 
formation  sheet  and  cooperated  in  the  design  of  a  new  form,  the 
Social  Work  Service  Intake  Interview  Information  Sheet  (Appendix 
F),  which  served  the  dual  purposes  of  furnishing  information  to 
the  counselor  and  capturing  data  required  for  the  study. 

Figure  4  illustrates  the  patient  appointment  and  treatment 
system  as  modified  by  the  research  design.  The  system  is  iden¬ 
tical  to  the  previous  system  from  the  telephonic  receipt  of  the 
appointment  request  to  that  point  where  the  patient  either  shows 
or  fails  to  show  for  the  appointment.  The  data  collection  pro¬ 
cedure  was  specifically  designed  to  assure  that  during  the  ap¬ 
pointing  process  the  remarks  of  the  appointment  clerk  were  iden¬ 
tical  to  those  used  in  the  past.  However,  certain  actions  of 
the  clerk,  not  detectable  to  the  caller  during  the  telephonic 
conversation,  were  different.  When  the  caller  identified  him¬ 
self  as  a  new  patient  by  indicating  that  he  was  not  currently 
being  followed  at  the  clinic,  the  clerk  initiated  Part  I  of  the 
revised  Intake  Interview  Information  Sheet  and  completed  that 
portion  of  the  form  as  information  became  available.  At  the 
termination  of  the  call,  the  clerk  transferred  the  information 
to  the  appointment  book.  From  the  patient's  point  of  view,  the 
same  information  was  collected  in  precisely  the  same  manner  as 


under  the  previous  system.  Finally,  the  clerk  added  the  patient 
name  in  numerical  sequence  to  a  control  log  which  was  maintained 
for  newly  appointed  patients  in  support  of  the  study.  The  con¬ 
trol  log  (Appendix  G)  provided  the  researcher  a  means  of  track¬ 
ing  newly  appointed  patients  and  a  convenient  means  of  period¬ 
ically  coding  data  pertaining  to  the  variables  being  studied. 

Patients  who  reported  for  their  appointment  were  asked  to 
complete  Part  II  of  the  form  which  was  reviewed  by  the  recep¬ 
tionist  for  completeness  and  referred  to  the  counselor.  Fol¬ 
lowing  the  appointment,  the  Intake  Interview  Information  Sheet 
was  placed  in  that  patient's  record  and  maintained  in  a  file. 

For  patients  who  failed  to  show  for  their  appointment  or  can¬ 
celled  within  twenty-four  hours,  the  clerk  annotated  the  con¬ 
trol  log  and  the  Intake  Interview  Sheet.  Next,  the  receptionist 
attempted  to  contact  the  patient  telephonically  to  retrieve  the 
required  data  in  accordance  with  the  instructions  at  Appendix 
H.  These  instructions  were  designed  to  encourage  a  favorable 
response  through  a  consistently  applied  dialogue  which  would 
not,  of.  itself,  influence  the  individual's  response.  All  no- 
show  patients  were  successfully  contacted  and  all  agreed  to 
cooperate  with  the  study  by  providing  the  information  required. 
The  receptionist  forwarded  four  information  sheets  to  the  re¬ 
searcher  in  accordance  with  the  instructions  because  she  had 
not  successfully  contacted  those  patients  within  the  three  days 
specified.  One  of  the  four  had  indicated  no  telephone  number 
and  one  indicated  the  wrong  number,  neither  of  which  were  listed 


in  the  telephone  book,  but  both  of  which  were  retrieved  from 
the  patient's  outpatient  medical  record  maintained  at  Martin 
Army  Community  Hospital.  The  researcher  contacted  all  four 
patients,  followed  the  same  dialogue  as  prescribed  for  the 
receptionist,  and  retrieved  the  data. 

The  Historical  Clinic  No-show  Rate 
Limited  data  in  the  form  of  monthly  workload  reports  were 
available  in  the  Social  Work  Clinic  and  were  analyzed  to  pro¬ 
duce  several  models  of  no-show  behavior  based  on  historical 
clinic  experience.  The  data  available  was  limited  to  calendar 
year  1982  and  was  not  of  sufficient  detail  to  permit  an  analysis 
for  time  periods  of  less  than  one  month.  The  definitions  of 
terms  on  these  reports,  particularly  the  term  "no-show",  did 
not  conform  to  the  context  of  this  study,  and  it  was  necessary 
to  add  cancellations  to  the  reported  "no-shows"  in  order  to 
obtain  the  number  of  no-shows  consistent  with  the  parameters 
of  this  study.  Furthermore,  although  the  total  number  of  "no- 
show"  patients  had  been  clearly  recorded,  the  number  who  were 
also  newly  appointed  patients  was  not  retrievable.  Therefore, 
in  analyzing  the  historical  data,  the  staff's  impression  that 
most  (about  three-quarters)  of  the  "no-shows"  were  new  patients 
was  used  as  a  basis  for  calculating  an  estimated  number.  Sim¬ 
ilarly,  although  the  total  number  of  cancellations  was  recorded, 
neither  the  number  attributable  to  new  patients  nor  the  number 
initiated  by  the  clinic  was  indicated.  An  estimated  number  of 
cancellations  initiated  by  new  patients  was  derived  by  applying 


the  staff's  opinion  that  about  one-half  of  the  total  cancel¬ 
lations  were  caused  by  newly  appointed  patients  within  twenty- 
four  hours  of  the  scheduled  appointment. 

Based  on  these  assumptions,  the  monthly,  quarterly,  and 
annual  no-show  rates  for  new  patients  during  1982  were  calculated 
as  displayed  at  Table  3.  During  the  year,  an  average  of  sixty- 
eight  new  patients  per  month  were  scheduled  at  the  clinic.  New 
patients  accounted  for  nearly  25  percent  of  all  patients  sched¬ 
uled  and  an  estimated  26.3  percent  of  the  new  patients  either 
failed  to  show  or  cancelled  within  twenty-four  hours  of  their 
appointment.  These  findings  only  partially  support  the  pre¬ 
liminary  data  collected  by  the  Social  Work  Service  chief,  and 
the  researcher  was  not  able  to  confirm  the  initial  contention 
that,  from  January  to  October  1982,  the  no-show  rate  had  averaged 
49  percent. 

Figure  5  is  a  graph  of  monthly  no-show  rates  plotted  against 
time  to  show  seasonal  fluctuations.  From  the  graph  it  is  evident 
that  the  rate  fluctuated  greatly  during  the  first  quarter  of  the 
calendar  year,  steadied  at  a  relatively  low  level  during  the 
second  quarter,  rose  during  the  third  quarter,  and  fluctuated 
from  very  high  to  very  low  during  the  fourth  quarter.  In  ad¬ 
dition  to  the  very  general  no-show  models  based  strictly  on 
annual,  quarterly,  and  monthly  no-show  rates,  six  other  models 
were  created  from  the  1982  data.  Linear  regression  equations 
were  derived  from  various  combinations  of  data  to  determine 
whether  a  linear  relationship  existed  which  would  accurately 


MONTHLY  AND  QUARTERLY  NO-SHOW  RATES  FOR  THE  SOCIAL  WORK  SERVICE  CLINIC 


describe  clinic  no-show  patterns.  Figure  6  describes  the 
variables  investigated  and  the  linear  equations  derived  uti¬ 
lizing  the  least-squares  technique.  An  evaluation  of  the  re 
gression  equations  by  performing  a  t  test  on  the  correlation 
coefficients,  however,  leads  to  the  conclusion  that  none  of 
these  equations  show  a  significant  linear  relationship  to 
describe  the  no-show  patterns  of  the  clinic  during  1982. 


Dependent 

Variable 

Independent 

Variable 

Linear  I 

Equation  i 

Correlation 

Coefficient 

Number  of  Monthly 
No-shows  (New 
Patients) 

Number  of  Monthly 

New  Patient  Visits 

Y=26 .10  -  0.12X 

-0.37 

Number  of  Quarterly 
No-shows  (New 
Patients) 

Number  of  Quarterly 
New  Patient  Visits 

Y=61 .56  -  0.04X 

-0.12 

Number  of  Quarterly 
No-shows  (New 
Patients) 

Time  (Quarter  of 
the  Year) 

Y=44.50  +  3.60X 

0.47 

Number  of  Monthly 
No-shows  (New 
Patients) 

Time  (Month  of  the 
Year) 

Y=1 5 . 74  +  0.32X 

0.28 

No-show  Rate  for 

New  Patients 

Time  (Quarter  of 
the  Year) 

Y=25.30  +  0.58X 

0.13 

No-show  Rate  for 

New  Patients 

Time  (Month  of  the 
Year) 

Y=31 .79  -  0.41X 

-0.12 

Figure  6.  Linear  Regression  Equations  Derived  from  Historical  Data 


A  chi-square  analysis  was  performed  to  compare  the  annual, 

quarterly,  and  monthly  no-show  rates  at  the  95  percent  confidence 

level.  A  comparison  of  observed  quarterly  no-shows  and  those 

expected  by  applying  the  annual  no-show  rate  (26.29  percent) 

to  the  number  of  new  patients  seen  each  quarter  showed  that  the 

quarterly  rate  is  significantly  different,  i.e.,  more  precise 

(X  =9.12 ,df=3,p<.05) .  A  similar  comparison  between  monthly  no- 

shows  and  those  expected  from  the  quarterly  no-show  rate  showed 

that  the  monthly  rate  is  not  significantly  different  than  the 

o 

quarterly  rate  ( X  =1 6 . 08  ,df  =  1 1  ,  p>.  1  ) .  Therefore,  it  was  con¬ 


cluded  that  of  all  the  models  derived  from  the  1982  data,  the 
quarterly  no-show  rate  provides  the  best  clinic-based  model  of 


3 


no-show  behavior. 

Descriptive  Analysis  of  the  Data 

Data  was  collected  for  new  patients  appointed  to  the  Social 
Work  Service  Clinic  during  the  period  6  January  through  8  April 
1983.  Using  the  Social  Work  Service  Intake  Interview  Information 
Sheet  as  a  source  document,  the  researcher  coded  variables  as 
described  in  Appendix  D,  transferred  the  data  to  computer  punch 
cards,  and  entered  the  data  records,  data  definition  cards,  and 
task  definition  cards  into  the  SPSS  subprogram  FREQUENCIES. 

The  output  from  this  subprogram  was  a  variety  of  descriptive 
statistics  and  frequency  distribution  tables  for  all  patients 
appointed  during  the  study,  for  the  group  who  showed  for  their 
appoi ntments ,  and  for  the  group  who  did  not  show.  A  summary 
of  this  analysis  is  at  Appendix  I.  Included  are  the  results  of 
chi-square  analyses  testing  for  the  significance  of  differences 
between  the  show  and  the  no-show  groups  with  respect  to  the 
variables  measured. 

The  summary  statistics  reveal  a  great  deal  about  the  Social 
Work  Service  Clinic  and  the  population  served.  While  waiting 
time  ranged  from  zero  to  nine  days,  the  average  patient  waited 
less  than  three  days  for  an  appointment,  including  weekends  when 
the  clinic  is  closed.  87  percent  of  the  clients  had  never  used 
the  Fort  Benning  Social  Work  Service  Clinic  before  and  two-thirds 
had  never  used  any  form  of  social  services  counseling  in  the  past 
Nearly  one-half  of  the  patients  requesting  initial  appointments 
were  referred  from  an  outpatient  clinic  at  Martin  Army  Community 
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Hospital  and  most  were  scheduled  with  one  of  the  civilian 
counselors  employed  at  the  clinic.  Most  of  the  patients  trans¬ 
ported  themselves  to  the  clinic  from  residences  located  apart 
from  the  Fort  Benning  military  reservation.  Compared  to  the 
population  profile  described  at  Table  2,  the  dependent  popula¬ 
tion  visited  the  clinic  approximately  twice  as  frequently  as 
expected,  a  situation  explained  by  the  clinic  policy  of  not 
treating  active  duty  soldiers  without  dependents.  Finally, 
the  summary  statistics  reveal  that,  although  the  clinic  staff 
believed  financial  difficulties  would  constitute  a  major  prob¬ 
lem  type  for  new  patients,  none  of  the  patients  included  in 
the  study  classified  their  problem  as  a  financial  one. 

Chi-square  analyses  for  differences  between  the  show  and 
no-show  groups  were  performed  to  determine  which  patient  char¬ 
acteristics  contained  the  greatest  variability  and  to  identify 
the  characteristics  which  would  probably  have  the  greatest  im¬ 
pact  on  the  two-group  discriminant  analysis.  The  only  statis¬ 
tically  significant  relationship  pertained  to  the  delay  between 
the  appointment  request  and  the  date  of  the  scheduled  appoint¬ 
ment.  The  chi-square  analysis  revealed  that  patients  who  were 
required  to  wait  longer  for  their  appointments  failed  to  show 
more  frequently  than  those  who  were  appointed  more  promptly. 
This  finding  is  consistent  with  results  generally  reported  in 
the  literature.  Three  other  characteristics  (referral  source, 
problem  types,  and  sponsor's  rank)  displayed  results  which  were 
not  in  themselves  significantly  correlated  with  show  or  no-show 


39 


behavior.  The  results  of  the  chi-square  analyses,  however, 
did  indicate  that  the  combined  effect  of  these  variables  might 
reach  statistical  significance  when  included  in  the  SPSS  dis¬ 
criminant  analysis. 


Discriminant  Analysis  of  the  Data 
The  objective  of  the  discriminant  analysis  technique  is 
to  develop  a  decision  rule  in  the  form  of  a  discriminant  func¬ 
tion  which  will  serve  the  dual  practical  uses  of  analyzing 
known  population  samples  for  characteristics  consistent  with 
group  membership  and  classifying  unknown  population  samples  in 
order  to  predict  likely  group  membership.  The  decision  rule 
is  derived  mathematically  by  weighting  and  forming  a  linear 
combination  of  the  variables  collected  by  the  researcher  to 
form  a  discriminant  function  of  the  form 
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where  L  is  the  value  of  the  discriminant  function,  X  is  the 
measured  value  of  each  observed  variable,  and  B  is  the  weight¬ 
ing  coefficient  associated  with  each  of  the  p  discriminating 
variables.  The  optimal  discriminating  function  is  that  which 
optimizes  this  equation  in  such  a  way  that  the  values  computed 
for  members  of  each  group  are  as  statistically  distinct  as  pos 
sible.  One  weakness  of  discriminant  analysis  is  that  the  re¬ 
searcher  must  determine  in  advance  those  groups  and  variables 
to  be  considered.  These  preliminary  decisions  made  by  the  re¬ 
searcher  may  not,  in  fact,  provide  the  most  relevant  input  for 
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the  analysis  and  may  not  lead  to  the  most  conclusive  results. 
Another  weakness  is  that  this  method  relies  on  a  greater  vari¬ 
ation  of  L  between  groups  than  among  group  members,  a  condition 
which  may  not  exist  and  which  may  lead  to  inconclusive  results. 
The  strength  of  discriminant  analysis  is  that  since  the  data 
collected  consists  of  mutually  correlated  variables,  the  most 
accurate  analysis  will  be  derived  from  this  technique  which 
considers  combinations  of  intercorrelated  variables  rather  than 
one  variable  at  a  time.^ 

The  SPSS  subprogram  DISCRIMINANT  was  used  to  accomplish  the 
analysis  function  in  a  stepwise  manner  whereby  the  single  best 
discriminating  variable  was  selected  according  to  the  parameters 
described  below,  paired  with  the  other  available  variables  one 
at  a  time  and,  provided  the  specified  selection  criteria  were 
achieved,  the  best  combination  of  two  variables  was  entered  into 
the  discriminant  function.  This  step-by-step  procedure  was  re¬ 
peated  with  that  combination  of  variables  continually  selected 
which  was  best  able  to  improve  the  discriminating  value  of  the 
function.  The  selection  criterion  used  for  determining  whether 
to  add  a  new  combination  of  variables  to  the  function  was  the 
overall  multivariate  F  ratio  to  test  the  differences  among  the 
group  centroids.  Group  centroids  are  the  mean  discriminant 
scores  for  each  group  and,  as  the  distance  between  group  cen¬ 
troids  increases,  the  discriminating  power  of  the  function  in¬ 
creases.  That  variable  which  maximized  the  F  ratio  was  selected 
for  inclusion  as  long  as  its  partial  F  ratio  exceeded  a  value  of 
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1.0.  Therefore,  when  a  variable  was  selected  for  entry  into 

the  discriminant  function,  it  added  significantly  to  the  amount 

2 

of  separation  between  the  group  centroids. 

In  addition  to  the  F-to-enter  ratio  described  above,  several 
other  parameters  were  incorporated  into  the  analysis.  The  F-tc- 
remove  value  was  also  established  as  1.0  and  allowed  for  the 
possibility  that,  as  the  stepwise  procedure  continued,  variables 
previously  selected  might  lose  their  discriminating  power  due  to 
their  information  being  contained  in  another  combination  of 
variables.  The  tolerance  level  was  set  at  .001  to  assure  the 
inclusion  of  only  those  variables  which  would  be  compatible  with 
the  internal  mathematical  program  and  which  would  not  result  in 
large  rounding  errors  in  the  discriminant  coefficients.  Finally, 
a  maximum  of  ten  steps  was  specified  to  assure  that  the  stepwise 
procedure  would  be  repeated  sufficient  times  to  produce  the  most 

3 

valid  discriminant  function. 

The  complete  printed  output  from  the  subprogram  DISCRIMINANT 
is  at  Appendix  J.  Since  only  two  groups  had  been  defined  in  the 
research  design,  i.e.,  patients  who  showed  for  their  appointments 
and  those  who  failed  to  show,  only  one  discriminant  function 
could  be  derived.  A  random  number  generating  feature  of  the 
SPSS  program  was  used  to  divide  the  data  evenly  between  the  anal¬ 
ysis  portion  and  a  holdout  portion  which  would  be  used  to  test 
the  adequacy  of  the  discriminating  model  produced.  In  order  to 
comply  with  the  condition  that  the  number  of  cases  analyzed 
should  equal  at  least  ten  times  the  number  of  variables,  five 
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of  the  patient  characteristics  were  selected  as  candidates  for  • 

inclusion  in  the  discriminant  function  primarily  on  the  basis 
of  the  chi-square  analyses  described  earlier.  The  five  vari¬ 
ables  selected  were:  days  delay  awaiting  the  appointment  (DELAY), 

i 

referral  source  (REFERBY),  military  status  (MILSTAT),  problem 
type  (PROB),  and  sponsor's  rank  (SPONRANK). 

At  step  one  of  the  discriminant  analysis,  the  variable  DELAY 
was  selected  as  the  single  best  discriminator  between  shows  and 
no-shows.  At  this  point,  only  SPONRANK  in  combination  with 
DELAY  contained  an  F-to-enter  value  exceeding  the  minimum  of  1.0. 

After  SPONRANK  was  included  in  the  discriminant  function  at  step 
two,  none  of  the  remaining  variables  when  combined  with  SPONRANK 
and  DELAY  added  significantly  to  the  separation  of  centroids  for 
the  show  and  no-show  groups.  At  this  point,  the  discriminant 
analysis  terminated  and  the  coefficients  shown  in  Table  4  were 
calculated . 


TABLE  4 

DISCRIMINANT  FUNCTION  COEFFICIENTS  FROM  THE  SPSS  ANALYSIS  OF  DATA 


Variable 

Standardized 

Discriminant 

Function 

Coefficients 

Unstandardized 

Discriminant 

Function 

Coefficients 

Classification 

Function 

Coefficients 

Show 

No-Show 

DELAY 

0.74321 

0.3118804 

0.4463719 

0.7173132 

SPONRANK 

-0.70399 

-0.2636750 

0.8917860 

0.6627225 

(Constant) 

0.5975262 

-4.209511 

-3.858131 

L  =  -.  420951  1  +  0.44 6371  9 ( VE LA  V ) + 0 .  &  9  1  7 8 6 0  ( SPONRANK ) 

and 

L=  3.&5&13U0.  71  731  32  (VELAV) +0 . 662I22S  (5P0WRAWK) 
are  useful  for  classifying  cases  as  likely  shows  or  no-shows. 

By  calculating  the  show  score  from  the  first  equation  and  the 
no-show  score  from  the  second  equation,  the  researcher  can  easily 
classify  the  case  by  selecting  the  group  with  the  higher  com¬ 
puted  score.  ® 

To  test  the  adequacy  of  the  discriminant  function,  discrimi¬ 
nant  scores  were  calculated  for  each  of  the  fifty-four  cases 
which  were  used  to  derive  that  function  separately  on  the 
forty-seven  cases  which  were  not  used.  The  cases  were  then 
categorized  as  shows  or  no-shows  by  placing  them  in  the  group 
for  which  their  score  indicated  the  greatest  probability  of 
membership.  The  results  of  these  classification  tests  of  the 
discriminant  function  are  shown  in  Tables  5  and  6. 

TABLE  5 


CLASSIFICATION  RESULTS  FOR  CASES  USED  TN  THE  DISCRIMINANT  ANALYSIS 


Predicted 

Behavior 

Actual  Behavior 

Show 

No-show 

Showed  (39  patients) 

23(59.0%) 

16(41.0%)  Error 

Did  not  Show  (15  patients) 

5(33.3%)  Error 

10(66.7%) 

Percent  of  Patients  Correctly  Classified:  61.11% 


CLASSIFICATION  RESULTS  FOR  CASES  NOT  USED  IN  THE  DISCRIMINANT  ANALYSIS 


_ _ Predicted  Behavior _ 

_  Actual  Behavior _ Show _ No-Show _ 

Showed  (35  patients)  27(77.1%)  8(22.9%)  Error 

Did  not  Show  (12  patients)  6(50.0%)  Error  6(50.0%) 

Percent  of  Patients  Correctly  Classified:  70.21% 

The  results  of  these  classification  tests  require  interpre¬ 
tation.  The  test  on  data  previously  used  to  derive  the  discrim 
inant  function  (Table  5)  is  not  considered  a  good  evaluation  of 
the  function  for  adequacy  in  predicting  behavior  within  the  gen 
eral  population  because  bias  is  forced  into  the  function  as  it 
is  mathematically  fitted  to  that  particular  data  set.  A  much 
stronger  test  for  the  adequacy  of  the  function  is  to  categorize 
the  holdout  sample  (Table  6)  and  compare  predicted  to  actual 
group  membership.  In  this  study  both  tests  were  used  and  the 
results  were  highly  unusual.  For  the  cases  which  had  been  used 
in  the  analysis,  only  61.11  percent  were  correctly  classified. 
For  the  holdout  sample,  however,  70.21  percent  were  correctly 
classified,  an  improvement  which  can  be  explained  by  the  rela¬ 
tively  small  sample  size  and  chance  in  the  random  selection  of 
cases  for  analysis.  One  factor  limiting  the  correct  classifi¬ 
cation  of  cases  is  that  the  group  centroids  for  the  show  and  no 
show  groups  were  not  well  separated  and,  when  plotted,  discrim¬ 
inant  scores  for  shows  and  no-shows  overlapped  greatly. 


In  evaluating  the  adequacy  of  the  clinic  no-show  model 
derived  from  the  two -group  discriminant  analysis  of  data  per- 
training  to  patient  characteristics,  an  important  distinction 
must  be  made.  If  the  research  problem  were  to  derive  that  model 
which  would  most  accurately  describe  all  patient  behavior,  then 
this  model  and  the  model  based  on  quarterly  clinic  no-show  rates 
would  be  comparable  with  both  models  correctly  classifying  pa¬ 
tients  approximately  70  percent  of  the  time.  In  the  case  of 
the  clinic-based  model,  the  analyst  would  simply  predict  that 
all  patients  would  show  and,  depending  upon  the  quarter  of  the 
year,  would  be  69.46,  82.13,  69.72,  or  71.65  percent  accurate. 
The  research  problem,  however,  is  not  to  describe  all  patient 
behavior,  but  to  describe  patient  no-show  behavior.  Therefore, 
the  patient  characteristic  model  derived  from  discriminant 
analysis  is  clearly  superior  because  it  correctly  predicts  50 
percent  of  those  patients  who  would  fail  to  show  for  the  sched¬ 
uled  appointment,  while,  at  best,  clinic-based  model  can  only 
predict  30.54  percent  of  the  no-shows  by  assuming  that  all  pa¬ 
tients  would  fail  to  show  during  the  first  quarter.  Therefore, 
based  on  the  results  of  the  classification  test  on  the  holdout 
sample,  the  patient  characteristic  model  is  preferable  for  i  den  - 
tifying  the  likely  no-show  patient  and  directing  intervention 
to  reduce  the  no-show  rate. 

Additional  Models  Derived  from  the  Data 


models  of  no-show  behavior  for  newly  appointed  patients  at  the 
Social  Work  Service  Clinic.  One  model  was  derived  by  applying 
the  unstandardized  coefficient  discriminant  function  to  all 
possible  combinations  of  sponsor's  rank  and  days  delay,  calcu¬ 
lating  the  discriminant  scores,  and  identifying  as  no-shows 
those  cases  with  scores  in  excess  of  0.19305  (the  mean  of  the 
group  centroids).  This  model  is  displayed  at  Figure  7  with 
critical  discriminant  scores  indicated.  All  combinations  which 
fall  below  the  stepping-stone  line  should  be  predicted  as  no- 
shows.  An  almost  identical  model,  not  shown,  can  be  derived  by 
calculating  the  mean  (0.3412)  and  standard  deviation  (0.9480)  of 
the  discriminant  scores  for  all  twenty-seven  no-shows  (one  no- 
show  case  was  missing  SP0NRANK  data  and  could  not  be  used  in 
the  analysis)  and  calculating  an  80  percent  confidence  interval 
within  which  most  no-show  cases  should  appear.  The  lower  limit 
of  this  confidence  interval  prescribes  that  cases  with  a  cal¬ 
culated  discriminant  value  exceeding  0.1843  should  be  classified 
as  no-shows.  This  value  is  so  close  to  the  cutoff  value  pre¬ 
scribed  in  the  previous  model  that  the  model  derived  from  the 
80  percent  confidence  interval  is  adequately  portrayed  by  Figure 
7.  To  test  the  adequacy  of  this  model,  the  twenty-seven  actual 
no-shows  were  plotted  and  it  was  determined  that  the  model  cor¬ 
rectly  identified  seventeen,  or  60.71  percent.  Not  only  does 
this  model  represent  an  improvement  in  the  level  of  prediction 
successes,  but  it  also  provides  a  far  more  practical  decision¬ 
making  tool  for  the  clinic  manager  and  appointment  clerk  than 
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does  the  discriminant  equation  alone. 
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Figure  7.  A  Stepping-stone  Model  for  Describing  No-Show  Behavior  for 
Newly  Appointed  Patients  of  the  Social  Work  Service  Clinic 


The  final  model  suggested  by  the  results  of  the  discriminant 
analysis  was  a  scatter  diagram  of  the  twenty-seven  no-show  cases 
as  shown  at  Figure  8.  A  visual  inspection  of  this  diagram  re¬ 
vealed  that  twenty-one  of  the  no-shows,  or  81  percent,  fall 
within  the  parameters  of  sponsor's  rank  between  E-4  and  E-7  and 
delays  of  two  days  or  greater.  Not  only  did  this  model  best 
predict  no-show  behavior,  but  it  also  presented  the  simplest 
decision-making  tool  for  use  by  clinic  personnel. 
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Figure  8. 
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A  Scatter  Diagram  Model  for  Describing  No-Show  Behavior 
for  Newly  Appointed  Patients  at  the  Social  Work  Service 
Clinic 


The  Optimal  Feasible  Alternative  for  Reducin 


the  Cnmc  No-Show  Rate 


The  researcher  and  the  Social  Work  Service  Clime  chief  dis¬ 
cussed  the  implications  of  the  best  no-show  model  emerging  from 
the  study,  identified  feasible  approaches  for  reducing  the  oc¬ 
currence  of  that  phenomenon,  and  selected  the  optimal  feasible 
alternative  to  be  implemented.  The  results  of  the  study  sug¬ 
gested  six  alternatives  for  reducing  the  no-show  rate  for  newly 
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appointed  patients.  The  first  approach  was  to  selectively 
overbook  those  patients  identified  by  the  model  as  comprising 
the  majority  of  clinic  no-shows.  Mailed  and  telephonic  re¬ 
minders  were  considered  as  separate  alternatives  with  the  pro¬ 
visions  that  telephonic  reminders  would  be  used  only  for  patients 
prescribed  by  the  model  and  that  mailed  reminders  would  be  used 
for  those  patients  only  if  the  delay  exceeded  three  days.  The 
fourth  alternative  allowed  for  flexible  scheduling  where,  for 
non-crisis  patients,  the  appointment  clerk  would  use  the  model 
to  systematically  reserve  earlier  appointment  spaces  for  ap¬ 
pointees  with  lower  ranking  sponsors  by  scheduling  those  with 
higher  ranking  sponsors  further  out.  In  conjunction  with  this 
procedure,  the  appointment  clerk  would  transfer  all  new  callers 
to  a  counselor  for  a  telephonic  intake  interview  during  the  ap¬ 
pointing  process.  The  fifth  alternative  was  identical  to  the 
fourth  except  that  only  callers  prescribed  by  the  model  would 
be  transferred  to  a  counselor  for  the  intake  interview.  The 
final  alternative  was  to  take  no  action  and  accept  the  high  no- 
show  rate  for  newly  appointed  patients. 

Following  the  identification  of  feasible  alternatives,  the 
most  relevant  criteria  for  evaluating  those  alternatives  were 
selected.  The  cost  of  implementing  the  alternative  was  con¬ 
sidered  subjectively  from  the  standpoint  of  additional  costs 
imposed  and  the  cost  of  other  tasks  not  done  or  delayed.  The 
time  required  to  train  the  staff  and  routinely  accomplish  the 
alternative  was  evaluated.  Staff  acceptance  was  considered 


from  the  viewpoint  of  the  full-time  counselors  at  the  clinic 
and  the  impact  of  the  alternative  on  staff  work  requirements 
and  morale.  Patient  acceptance  included  a  consideration  of 
a  "caring"  image  communicated  to  the  patient.  The  change  in 
quality  of  care  was  evaluated  by  considering  the  guidance  pro¬ 
vided  in  the  JCAH  quality  assurance  standard  for  ambulatory 
care.  Finally,  consideration  was  given  to  how  each  alternative 
would  affect  the  workload  or  the  number  of  patients  treated  at 
the  clinic. 

The  payoff  matrix  at  Table  7  was  used  to  analyze  each  al¬ 
ternative  in  terms  of  the  criteria  selected.  Alternatives  were 
ranked  in  numerical  order  according  to  how  well  each  criterion 
would  be  accommodated  by  that  alternative  with  the  lowest  num¬ 
ber  reflecting  the  best  performance.  For  example,  considering 
the  first  criterion  of  cost,  it  was  determined  that  the  status 
quo  would  incur  no  additional  cost  while  mailed  reminders  would 
incur  the  most  cost.  Considering  all  six  criteria,  overbooking 
emerged  as  the  weakest  alternative,  followed  closely  by  the 
status  quo.  Mailed  and  telephonic  reminders  showed  some  ad¬ 
vantages,  but  the  alternatives  combining  flexible  scheduling 
and  telephonic  intake  interviews  performed  best  against  the 
criteria  selected.  The  optimal  feasible  alternative  was  the 
flexible  scheduling  of  non-crisis  patients  in  conjunction  with 
telephonic  intake  interviews  for  patients  with  sponsor's  rank 
between  E-4  and  E-7  and  two  or  more  days  delay. 
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TABLE  7 

A  COMPARISON  OF  SIX  ALTERNATIVES  TO  REDUCE  THE  NO-SHOW  RATE 
FOR  NEW  PATIENTS  APPOINTED  AT  THE  SOCIAL  WORK  SERVICE  CLINIC 


Implementation  of  the  Optimal  Feasible  Alternative 
The  application  phase  of  the  study  consisted  of  implementing 
the  selected  alternative  for  a  period  of  thirty  days  and  record¬ 
ing  the  results.  Prior  to  implementation,  the  Social  Work  Ser¬ 
vice  chief  and  the  researcher  prepared  the  instruction  sheet  at 
Appendix  K  and  briefed  the  appointment  clerk  to  assure  her  under¬ 
standing  of  how  to  appoint  patients  under  the  flexible  appoint¬ 
ment  system  and  which  patients  to  refer  for  a  telephonic  intake 
interview.  Also,  the  general  format  of  the  telephonic  intake 
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interview  was  discussed  and  the  chief  briefed  all  social 
workers  on  that  procedure.  The  format  itself  was  flexible, 
but  in  all  cases  was  directed  towards  rapport  building.  The 
counselor  asked  questions  of  the  caller  to  determine  the  nature 
of  the  problem,  the  expectations  of  the  individual,  what  other 
attempts  had  been  made  to  resolve  the  problem,  and  whether  the 
problem  should  be  handled  at  the  Social  Work  Service  Clinic  or 
referred  elsewhere. 

During  the  period  20  April  through  19  May  1983,  thirty-three 
new  patients  were  appointed  at  the  olinic.  Of  these,  fourteen 
were  referred  to  a  counselor  for  a  telephonic  interview  in  ac¬ 
cordance  with  the  implementation  instructions.  All  other  pa¬ 
tients  were  either  appointed  in  less  than  two  days  or  indicated 
a  sponsor's  rank  outside  the  range  E-4  to  E-7.  During  this 
period,  the  clinic  experienced  three  no-shows  (9.1  percent),  in¬ 
cluding  one  cancellation  within  twenty-four  hours  of  the  sched¬ 
uled  appointment.  In  addition,  three  patients  cancelled  more 
than  twenty-four  hours  before  the  appointment  and  those  appoint¬ 
ment  spaces  were  subsequently  filled.  Compared  to  patient  be¬ 
havior  during  the  previous  three-month  period  of  the  study,  the 
decrease  in  the  no-show  rate  is  significant  (X  =4 . 77  ,df  =  1  ,p<. 05 ) 
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III.  CONCLUSIONS 


In  order  to  determine  the  best  model  for  describing  the 
no-show  rate  for  new  patients  appointed  at  the  Social  Work 
Service  Clinic  and  the  optimal  feasible  method  for  reducing 
that  phenomenon,  a  three-phased  project  was  undertaken.  During 
the  preliminary  phase,  clinic  operating  procedures  were  studied 
to  provide  the  basis  for  a  data  collection  mechanism  which  would 
not  interfere  with  the  functioning  clinic  or  patient  behavior. 
The  clinic  staff  was  briefed  in  order  to  gain  their  support  and 
input  concerning  those  variables  which  should  be  measured  during 
the  study.  A  data  collection  form  was  designed  and  clerical 
personnel  trained  to  accomplish  the  data  collection  portion  of 
the  study. 

During  the  data  collection  and  analysis  phase,  no-show  data 
from  the  previous  year  was  analyzed  and  it  was  determined  that 
the  best  no-show  model  based  on  the  historical  data  was  the 
quarterly  no-show  rate.  Patient  characteristic  data  was  col¬ 
lected  for  a  three-month  period,  coded,  and  analyzed  utilizing 
the  SPSS  subprograms  FREQUENCIES  and  DISCRIMINANT.  Chi-square 
analyses  were  performed  to  test  for  differences  in  character¬ 
istics  between  patients  who  showed  and  those  who  failed  to  show 
for  appointments  during  the  period  of  the  study.  The  only 


variable  which  showed  a  statistically  significant  relationship 
was  the  delay  between  the  appointment  request  and  the  appoint¬ 
ment  date.  A  two-group  discriminant  analysis  was  performed  and 
a  discriminant  equation  incorporating  days  delay  and  rank  of 
the  military  sponsor  was  derived  and  tested.  It  was  determined 
that  this  model  based  on  patient  characteristics  was  superior 
to  the  clinic-based  model  derived  from  the  historical  data. 

Three  graphical  models  were  derived  from  an  examination  of  the 
discriminant  equation,  and  it  was  determined  that  the  best  model 
for  describing  the  no-show  rate  for  new  patients  at  the  Social 
Work  Service  Clinic  was  a  scatter  diagram  of  sponsor's  rank  on 
one  axis  and  days  delay  on  the  other. 

The  application  phase  began  with  an  evaluation  of  alterna¬ 
tives  for  reducing  the  clinic  no-show  rate.  The  optimal  feasible 
alternative  for  reducing  that  phenomenon  was  the  flexible  appoint 
ment  system  in  conjunction  with  telephonic  intake  interviews  for 
selected  cases.  This  system  was  implemented  for  a  trial  period 
of  thirty  days  and  the  clinic  no-show  rate  during  that  period 
was  reduced  significantly. 

Implications  of  the  Study 

This  study  demonstrated  that  clinic  no-shows  are  related  to 
identifiable  and  quantifiable  factors  which  can  be  associated 
with  certain  characteristics  of  the  patient.  Furthermore,  this 
study  demonstrated  that  the  clinic  manager  is  not  limited  to 
merely  acknowledging  that  a  no-show  problem  exists,  nor  is  he 


limited  to  the  more  traditional  means  of  dealing  with  this 
problem.  Contrary  to  the  conclusion  of  Dervin,  et  al.  J 
discriminant  analysis  emerged  as  a  potentially  powerful  tool 
for  analyzing  large  quantities  of  data,  determining  the  com¬ 
bined  effect  of  multiple  i ntercorrel ated  variables,  identifying 
those  combinations  of  variables  which  most  significantly  affect 
no-show  behavior,  and  suggesting  to  the  researcher  practical 
models  which  can  be  used  to  direct  concentrated  efforts  at  re¬ 
ducing  the  no-show  phenomenon  in  a  cost-effective  manner.  Al¬ 
though  in  this  study  only  two  variables  needed  to  be  determined 
by  the  appointment  clerk  in  order  to  efficiently  direct  positive 
actions  at  that  population  segment  most  likely  to  otherwise  miss 
their  appointments,  multiple  variables  may  emerge  from  similar 
studies  conducted  at  other  clinic  sites.  In  these  situations, 
the  challenge  to  the  investigator  is  to  translate  the  compli¬ 
cated  discriminant  function  into  a  practical  working  decision 
tool.  Innovative  thinking  will  be  required  to  combine  comple¬ 
mentary  variables  and  create  a  decision  model  which  can  be 
understood  and  easily  applied  by  the  appointment  clerk. 

Future  Applications  Within  the 
Military  Health  Care  Delivery  System 

The  methodology  utilized  throughout  this  study  is  entirely 
applicable  to  alternate  sites  and  patient  populations.  Many 
clinical  areas  in  military  health  care  institutions  with  un¬ 
acceptably  high  no-show  rates  are  characterized  by  a  high  degree 
of  physical  activity.  Patient  volume  is  typically  much  greater 
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than  that  encountered  during  this  study  and  the  demands  on  the 
clinic  appointment  clerk  and  receptionist  are  much  greater.  In 
such  an  environment,  the  researcher  would  be  well  advised  to 
design  a  data  collection  mechanism  to  minimize  the  burden  on 
clerical  personnel.  By  collecting  all  data  tel ephoni cal ly  dur¬ 
ing  the  appointing  process  and  creating  a  control  group,  the 
time  consuming  requirement  to  contact  patients  who  fail  to  show 
for  their  scheduled  appointment  would  be  eliminated.  The  vari¬ 
ables  to  be  studied  should  be  carefully  screened  for  relevance 
and  limited  to  those  seriously  thought  related  to  no-show  be¬ 
havior  and  only  to  those  which  would  be  of  practical  utility  in 
lowering  the  no-show  rate.  Certain  variables  from  this  study 
which  showed  promise,  such  as  delay,  sponsor's  rank,  length  of 
service,  referral  source,  and  problem  type,  should  be  consid¬ 
ered  for  future  studies.  Others,  such  as  sponsor's  job,  should 
be  redefined  to  possibly  reveal  a  critical  influence  which  was 
obscured  by  the  broad  categories  defined  in  this  study.  In  a 
more  active  clinical  setting,  the  benefits  from  the  analytical 
capabilities  of  the  SPSS  subprograms  would  be  enhanced  as  a 
larger  volume  of  data  is  processed  and  analyzed  with  great  ef- 
f i ci ency . 

In  a  more  active  clinic  the  alternatives  considered  and 
selected  for  reducing  the  no-show  rate  may  not  duplicate  those 
in  the  less  active  Social  Work  Service  Clinic.  The  methodology 
utilized  in  this  study,  however,  will  identify  those  patients 
at  a  higher  risk  for  missing  appointments  and  will  guide  the 


manager  to  a  narrower  range  of  individuals  who  would  benefit 
most  from  the  selected  means  of  intervention.  Future  researchers 
should  consider  alternatives  not  tried  before,  but  which  have 
the  potential  for  success  in  that  clinical  setting.  Requiring 
patient  confirmation  of  appointments  or  reminding  patients  of 
public  transportation  systems  might  be  the  most  effective  action 
in  a  given  clinical  setting  while  overbooking  or  reminders  might 
be  more  feasible  elsewhere. 

The  military  health  care  manager  can  no  longer  afford  to 
absorb  the  deleterious  effects  of  patients  who  fail  to  show 
for  clinic  appointments.  Neither  can  he  continue  to  function 
effectively  without  the  capability  of  utilizing  up-to-date  tech¬ 
niques  in  analyzing  no-show  behavior  and  implementing  cost-ef¬ 
fective  actions  designed  to  maximize  clinic  efficiency.  The 
methodology  described  in  this  graduate  research  project  has 
proven  its  effectiveness  in  a  low  volume  clinic.  Future  re¬ 
search  should  concentrate  on  applying  this  methodology  to  clinics 
of  greater  patient  activity  as  an  effective  means  of  optimizing 
the  quantity  and  quality  of  health  care  delivered  in  an  environ¬ 
ment  characterized  by  increasingly  limited  resources. 
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^John  V.  Dervin,  David  L.  Stone,  and  Charles  H.  Beck,  "The  No-Show 
Patient  in  the  Model  Family  Practice  Unit,"  The  Journal  of  Family  Practice 
7  (June  1978):  1180. 
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SOCIAL  WORK  SERVICE  CLIENT  INFORMATION 


(PLEASE  PRINT) 


NAME 


DATE 


HOME 


ADDRESS 


PHONE: 


WORK 


BIRTH  DATE 


DATE 


EDUCATION  IN  YEARS 


NAMES  &  AGES  OF  CHILDREN/FAMILY  MEMBERS_ 


DATE  OF  PRESENT  MARRIAGE 


DATE(S)  OF  PREVIOUS  MARRIAGES,  IF  ANY 


INFORMATION  ABOUT  SPONSOR 

SPONSOR'S  NAME  RANK  SSAN 


SPONSOR'S  UNIT 


CHECK  ONE:  ACTIVE  DUTY 
RETIRED 


DECEASED 


SPONSOR'S  MOS 


LENGTH  OF  SERVICE 


ETS 


IF  YOU  HAVE  HAD  PREVIOUS  COUNSELLING,  PELASE  STATE:  WHERE 

WHEN  " 


Briefly  state  your  reason  for  coming  to  Social  Work  Service.  If  referred,  why 
do  you  think  you  were  referred: _ 


**************************00  NOT  WRITE  BELOW  HERE***************************** 
IMPRESSION:  _ 


PLAN: 


FB(MED)FORM  30 
1  Oct  76 


(If  needed,  continue  on  reverse) 
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APPENDIX  E 

DEFINITIONS  USED  THROUGHOUT  THE  STUDY 


Definitions 


No-shows .--Patients  who  fail  to  report  for  their  scheduled 
appointments.  Not  included  in  this  group  are  patients  who  can¬ 
cel  or  postpone  appointments  twenty-four  hours  in  advance.  In¬ 
cluded  as  no-shows  are  patients  who  cancel  their  appointments 
within  twenty-four  hours  of  the  scheduled  time  because  the  ap¬ 
pointment  space  normally  cannot  be  filled  and  the  late  cancel¬ 
lation  has  the  same  effect  on  the  clinic  as  a  patient  who  fails 
to  show.  Terms  which  will  be  treated  as  synonyms  include 
"missed  appointments"  and  "failed  appointments". 

New  pat i ents . - - Pat i ents  who  are  not  currently  being  followed 
at  the  clinic.  Patients  previously  seen  at  this  clinic,  but 
not  currently  being  followed  are  considered  as  new  patients  for 
purposes  of  this  study.  "First-time  appontments "  and  "initial 
appointments"  are  synonymous  terms. 

Followed  pati ents . --Pati ents  who  have  been  treated  at  the 
clinic  initially,  are  registered  at  the  clinic,  and  are  sched¬ 
uled  to  return  for  additional  care  on  a  continuing  basis. 
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SOCIAL  WORK  SERVICE 
INTAKE  INTERVIEW  INFORMATION  SHEET 


PART  I  -  For  Clinic  Use 


Name(s): 


Home  Phone: 


Work  Phone: 


Check  if  apply: 

/  7  Seen  here  before 


/ _ /  Telephonic  consult 

requested  &  provided 


Appointment  made  b\ 


Self  Cdr  Spouse 
OPC  Parent 


Appointment  date: 


PART  II  -  For  Client  Use.  Please  take  a  few  moments  to  provide  the  following 
information  which  will  be  of  assistance  to  the  Counselor  (please  print): 


INFORMATION  ABOUT  THE  CLIENT 


Your  local  address: 


Do  you  have  a  telephone  installed  at  this  address?  (circle  one) 

a.  Yes 

b.  No 


What  transportation  arrangements  did  you  make  for  this  appointment?(circle  one) 

a.  I  drove  my  own  car 

b.  I  borrowed  a  car 

c.  Another  person  drove  me  here 

d.  I  walked 

e.  I  used  a  bus  or  taxi 

f.  Other  (please  specify)  _ 


Which  category  below  best  describes  who  this  appointment  is  for?  (circle  one) 

a.  A  married  couple,  one  of  whom  is  active  duty 

b.  Family  of  an  active  duty  member 

c.  A  retired  member 

d.  Family  of  a  retired  or  deceased  member 


Who  referred  or  directed  you  to  this  clinic?  (circle  one) 

a.  I  referred  myself  to  this  clinic 

b.  I  referred  my  child  or  my  spouse  to  this  clinic 

c.  My  spouse  referred  me  to  this  clinic 

d.  Someone  from  the  military  ur’t  referred  me  to  this  clinic 

e.  I  was  referred  from  another  hospital  clinic 

f.  Other  (please  specify)  _ 
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DATA  RETRIEVAL  INSTRUCTIONS  FOR  THE 
SOCIAL  WORK  SERVICE  NO-SHOW  STUDY 


Follow  the  instructions  for  completing  the  Intake  Interview  Information  Sheet 
for  patients  who  do  not  show  for  their  scheduled  appointments. 

When  a  new  patient  fails  to  show  for  their  appointment,  it  is  important  that 
the  receptionist  contact  them  promptly  (the  following  duty  day)  and  that  the 
approach  be  consistent.  Beginning  at  approximately  0900  hours,  attempts  will 
be  made  throughout  the  day  to  contact  the  client.  If  not  contacted  within 
three  duty  days,  forward  to  Major  Smith  for  action. 

Prior  to  calling  the  individual,  mark  the  client's  name  on  the  control  log 
to  indicate  that  the  patient  did  not  show  or  cancel  the  appointment  within 
24  hours.  Also,  write  "no-show"  across  the  top  of  the  patient's  Intake 
Interview  Information  Sheet. 

1.  "Hello.  This  is  Ms  Broussard  calling  from  the  Social  Work  Clinic.  May 

I  speak  with  _ ?" 

Note:  Speak  only  with  the  person  who  made  the  appointment  or  spouse. 

If  not  available,  ask  them  to  return  your  call  or  establish  a  time  when  you 
can  call  back. 

2.  "I  noticed  you  had  an  appointment  on  _  but  were 

unable  to  keep  it.  I  wonder  if  I  might  be  able  to  reschedule  another  ap¬ 
pointment  for  you?" 

Note:  Go  ahead  and  schedule  another  appointment  if  the  client  desires. 
Cross  out  the  original  appointment  date  on  the  Intake  Interview  Information 
Sheet  and  enter  the  new  appointment  date. 

3.  "Mr. /Mrs.  _ _ ,  we  are  doing  some  research  about  the 

population  we  serve  and  we  would  appreciate  your  input.  Would  you  mind  an¬ 
swering  a  few  questions?  I  assure  you,  your  answers  will  be  kept  confidential 
and  will  have  no  impact  on  you  personally." 

Note:  If  person  agrees,  go  ahead  and  ask  the  questions  (state  them  ap¬ 
propriately.  For  example,  for  question  #3,  ask  "What  arrangements  would  you 
have  had  to  make  yesterday  in  order  to  make  your  appointment?)  Circle  the 
most  appropriate  response.  If  the  person  wants  to  quit  during  questioning, 
explain  that  there  are  just  a  few  questions  left  and  that  you  truly  need  their 
cooperation.  If  the  person  does  not  agree  to  participate  in  the  questionnaire, 
try  step  4. 

4.  "I  wish  you  would  reconsider.  I  have  only  a  few  simple  questions  to  ask-- 
it  won't  take  but  a  few  minutes  and  your  input  may  help  us  to  improve  the  ser¬ 
vice  we  deliver.  For  example,  did  you  refer  yourself  to  our  clinic  or  did 
someone  else  direct  you  here?" 

Note:  If  the  person  still  refuses  to  cooperate,  forward  the  questionnaire 
to  Major  Smith  at  MEDDAC  Headquarters . 
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APPENDIX  J 


COMPUTER  PRINTOUT  FROM  THE  SPSS 
DISCRIMINANT  ANALYSIS  OF  THE  DATA 
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PATIENT  NO-SHOW  STUDY 


Beginning  2*0  April,  patients  will  be  appointed  under  a  flexible 
sys  tern . 

Ask  all  callers  for  the  sponsor's  name  and  grade.  Enter  this 
information  in  Part  I  of  the  Intake  Interview  Information  Sheet 
under  the  patient's  name. 

If  the  sponsor's  rank  is  between  E-4  and  E-7: 

1.  Try  to  appoint  either  the  same  day  or  the  next  calendar 
day. 

2.  If  unable  to  appoint  today  or  the  next  day,  appoint  as 
soon  as  possible  and  transfer  the  call  to  an  available 
counselor  for  a  telephonic  intake  interview.  Check  the 
Intake  Sheet  and  enter  the  counselor's  name. 


If  the  sponsor's  rank  is  not  between  E-4  and  E-7,  appoint  3  to  4 
calendar  days  from  now  to  save  spaces  for  others. 

NOTE: 


1.  This  procedure  applies  only  to  non-crisis  patients, 
contact  a  counselor  if  you  are  in  doubt. 


2.  E-4  to  E-7  includes: 

Speci al i sts 
Sergeants 
Staff  Sergeants 
Sergeants  First  Class 


does  not  include: 
Privates 

Master  Sergeants 
Sergeants  Major 
Warrant  Officers 
Li eutenants 
Captains 

Ma jors  and  above 
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